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Abstract 

The accessible information Iacc('^^) of an ensemble £ is the maximum mutual information between a 
random variable encoded into quantum states, and the probabilistic outcome of a quantum measurement 
of the encoding. Accessible information is extremely difficult to characterize analytically; even bounds on 
it are hard to place. The celebrated Holevo bound states that accessible information cannot exceed x(f ), 
the quantum mutual information between the random variable and its encoding. However, for general 
ensembles, the gap between the Iacc(i^^) and xi^) may be arbitrarily large. 

We consider the special case of a binary random variable, which often serves as a stepping stone 
towards other results in information theory and communication complexity. We give explicit lower 
bounds on the the accessible information lacc(f) of an ensemble £ = {{p, pq) , {1 — p, pi)} , with < p < 1, 
as functions of p and xi^)- The bounds are incomparable in the sense that they surpass each other in 
different parameter regimes. 

Our bounds arise by measuring the ensemble according to a complete orthogonal measurement that 
preserves the fidelity of the states po,pi- As an intermediate step, therefore, we give new relations 
between the two quantities laccl^-)? x(^) and the fidelity B(po,Pi)- 

1 Introduction 

Let X be a classical random variable taking values in a finite set {0, . . . , n — 1} such that Pr(X = i) = pi. 



Let M be an encoding of X into (possibly mixed) quantum states in a finite dimensional, say d-dimensional, 
Hilbert space C^, such that M = pi when X = i. This gives rise to an ensemble of quantum states E = 

{{Pi:Pi)]- 
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The mapping i ^ pi may be viewed as a quantum communication channel, and it is natural to ask how 
much information about X can be obtained from the transmitted signal M. The answer to this question 
depends heavily on the way we quantify the notion of "information". For example, one may seek to 
maximize the probability of guessing, via a measurement, the value i given an unknown state pi from the 
ensemble £ [9]. This quantity frequently arises in quantum communication, but has no simple description 
in terms of the ensemble. For a boolean random variable, the answer is related to the trace distance of the 
two density operators [9, pp. 106-108]. While no analytical expression for this probability is known in the 
general case, we can still place meaningful bounds on it (see, e.g., Ref. [18]). 

A different way of quantifying the information content of an ensemble arises in Quantum Information 
Theory. Consider a classical random variable that represents the result of a measurement of the 
encoding M according to the POVM M. The accessible information lacc('S^) of the ensemble £ is defined 
as the maximum mutual information 1{X : Y^) obtainable via a quantum measurement Ai: 

= max I(X : F^). (1) 
POVM M 

Accessible information is extremely difficult to characterize analytically, even for a binary random variable 
(see, e.g., Ref. [6, page 1222], where it is referred to as Shannon Distinguishahility) . In a celebrated result, 
Holevo [10] bounded the accessible information for an ensemble £ by the quantum mutual information 
between the random variable X and its encoding M: 

lacc(f) < X{£) = S(E4pi])-E,[S(p,)] = I(X:M), (2) 

where S(p) denotes the von Neumann entropy of a density matrix p, and 1{A : B) = S{A) + S(-B) — S{AB) 
denotes the mutual information of a bipartite quantum system AB, and Ej denotes the expectation (i.e., 
average), taken according to the distribution {pi} in the ensemble £. The quantity x{^) has come to be 
called the Holevo information of the ensemble. 

The Holevo bound is attained by ensembles of commuting states (equivalently, for classical mixtures). In 
fact, Ruskai [22, Section VII. B] (see also Ref. [21, Section 4.3]) proves that these are the only ensembles 
for which 1{X -.Y^) = 1{X : M) is possible for some fixed measurement. A theorem due to Davies [3, 
Theorem 3] establishes that there is a measurement with at most (fi outcomes that achieves accessible 
information for an ensemble of d-dimensional states. (See also Ref. [23, Lemma 5], and the conjecture in 
Refs. [17,20] regarding this measurement.) Consequently, the Holevo bound is attained only by ensembles 
of commuting states. There are ensembles for which Iacc('^^) may be arbitrarily smaller than x{^)'- ^ 
uniformly random ensemble of n states in a d-dimensional space (where d is suitably smaller than n) has 
this property with high probability. 

Lower bounds on lacc are hard to derive even for specific ensembles (cf. Refs. [4,14]). In the simplest case of 
a binary random variable, Fuchs and van de Graaf [6] relate accessible information to the trace distance and 
fidelity of the density matrices. Fuchs and Caves [5] also consider the case of a binary random variable, 
stopping short of an explicit lower bound. It is also conjectured that the two-outcome measurement 
achieving the trace-distance (or fidelity) between two pure states occurring with equal probability also 
achieves accessible information [17]. This was numerically verified, but not formally proven, by Osaki et 
al. [20]. We revisit this special case, and give a lower bound for accessible information in terms of Holevo 
information. We show the following: 

Theorem 1.1 Let £ = {(p, /jo)i(1 ~P^Pi)} ^6 O''^ binary ensemble over quantum states of any (finite) 
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dimension. Then 
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These lower bounds arise from a specific kind of measurement of the quantum states, namely, a measure- 
ment that preserves fidelity [5]. As an intermediate step, we therefore relate both accessible information 
and Holevo information to fidelity in different ways so as to give the stated bounds. 

Note that the first bound above, Eq. ([3j), may be negative for certain parameter regimes. For example, the 
bound is negative for an ensemble of two pure states at an angle of 7r/4, as the probability p approaches 0. 
This occurs because our measurement completely disregards the prior probability p, and because of the 
approximations we make in order to get an explicit relationship with Holevo information. The second 
bound is meaningful for all parameter regimes. On the other hand, for any two orthogonal states, the first 
bound is greater than the second for p {0, 1, 1/2}. 

The motivation for this work is to investigate the extent to which the Holevo bound Iacc('?) < x{£) is tight 
for binary ensembles. Note also that x{£) = ■ ^ by the Lanford-Robinson inequality [26, 

Eq. (2.3), page 238] (also [19, Theorem 11.10, page 518]). Our main theorem may thus be seen as a 
sharpening of these bounds. None of the previously known bounds provide a lower bound on accessible 
information as an explicit function of Holevo information. 

Relations between different measures of information in the binary case often form a stepping stone in 
results in information theory. For example, as explained in Ref. [4], the Holevo bound may be derived by 
studing the case of the binary ensemble. In complexity theory, these relations form the basis of strong, 
sometimes optimal, lower bounds for the quantum communication complexity of computing functions, as 
in Refs. [12,16]. They have also found application in the study of quantum interactive proof systems [15] 
and quantum coin flipping [1,24]. We expect that our inequalities provide a more operationally useful view 
of accessible information, and find similar application. 

2 Comparison with previous bounds 

A number of lower bounds on accessible information Iacc('?) are already known. Jozsa, Robb, and Woot- 
ters [14] bounded it for arbitrary (possibly non-binary) ensembles by the expected mutual information 
resulting from a uniformly random complete orthogonal measurement. The latter quantity depends solely 
on the average density matrix p = Ej/5j corresponding to the ensemble, and was defined as the suhen- 
tropy Q(/3) of the density matrix p. They also showed that for every density matrix p (of arbitrarily large 
finite dimension), subentropy expressed in bits is bounded as Q(p) < (1 — 7) log2e < 0.60995, where 7 is 
the Euler constant. Thus, the best possible lower bound resulting from the subentropy bound is 0.60995. 
Our bound. Theorem 11.11 (Eq. ([3])), is more sensitive to the ensemble. For example, it gives the sharper 
lower bound of 1 — -v/2e for an equally weighted binary ensemble £ for which x{£) = 1 ~ for any e G [0, 1]. 
Holevo X information arbitrarily close to 1 is achieved, among others, by a uniform distribution over two 
pure states whose inner product is arbitrarily close to 0. Thus our bound better reflects the ensemble- 
dependence of accessible information. 

Fuchs and Caves [4] considered a measurement of a binary ensemble £ that arises in one proof of the 
Holevo bound. This is a measurement M that minimizes the second derivative of the mutual informa- 
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Figure 1: Bounds for an ensemble £ = {(p, po), (1 — P-, pi)} of two pure states with inner-product 1/2. The 
bounds on ls,cc{£) are plotted as p varies in [0, 1]. 



tion I{X : Y^) (as defined in Section [T]) with respect to the variable p. The measurement may be 
computed numerically given any ensemble, and leads to a lower bound on accessible information for binary 
ensembles. In a few special cases with single qubit states, such as when the states are pure, or commute, 
the Fuchs-Caves measurement has a familiar description. In all these special cases, the measurement is in 
a basis that diagonalizes p po — (1 — p) pi', precisely the measurement that maximizes the probability of 
guessing i correctly given a state pi picked from the ensemble £. This measurement also preserves fidelity 
between the states po,Pi when p = 1/2, and the lower bound with which we start matches this (see the 
proof of Lemma [3.6p . Our final lower bounds are however weaker, since we make further approximations in 
order to relate accessible information to the Holevo x quantity. For p ^ 1/2, even our initial lower bound 
may be worse, since fidelity preserving measurements are independent of the value of p. 

Hall [7, Eq. 24, page 104] considered the lower bound on accessible information for arbitrary (possibly non- 
binary) ensembles that arises from the "pretty good measurement". A special case of this measurement, 
when the ensemble consists of pure states, was defined by Hughston, Jozsa, and Wootters [11], later 
named so and studied by Hausladen and Wootters [8]. The measurement may be viewed as a dual to 
ensembles, and is a natural candidate for state discrimination. The bound that arises from the pretty good 
measurement may also be computed numerically for any given ensemble, as with the previous two bounds. 
In all the cases of an ensemble with two-states that we studied numerically, the Hall bound follows the 
Fuchs and Caves bound very closely. We are not aware of any formal connection between the two, though. 
Our numerical findings differ from the ones originally presented by Hall, and have been verified by him in 
a private communication. (Figure 1 in [7, p. 104] is therefore in error.) 

Typically for applications in complexity theory and cryptography such as those mentioned in Section [U 
we seek simple functional relationships between different measures of information. All the three bounds 
discussed here can be evaluated numerically on a computer but seem not to lead to an explicit functional 
connection with Holevo-x information. Our work attempts to fill this gap. 

In Figures [lH3l we present a numerical comparison of the abovementioned bounds with the maximum of 
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Figure 2: Bounds for a uniform ensemble E = {(1/2, po)) (1/2, Pi)} of two pure states at an angle t with 
each other, as t varies in [0,7r/2]. 
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Figure 3: Bounds for an ensemble £ = {{p, pq),{1 — p, pi)} of a mixed qutrit state po = 0.01|0)(0| + 
0.01|1)(1| + 0.98|2)(2| and a pure qutrit state pi = \v){v\, where v = ya02|0) + \/(X96|l) + v^a02|2). The 
bound M is not plotted here. The bounds on lacc('f) are plotted as p varies in [0, 1]. 
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our lower bounds, which is denoted by T. The Jozsa et al. bound is marked as Q, the Fuch-Caves bound 
is marked as M, and the Hall bound is marked as L. In all the cases we plotted, our bound T is below M 
and L. Except when the probability p is close to or 1 in Figure El T is well above Q. For pure state 
ensembles with p = 1/2, the lower bound with which we start in Lemma 13.61 equals L and M. However, 
our final bound T is an approximation to this bound, and is lower (see Figure [2]). 

3 Lower bounds on accessible information 

3.1 Preliminaries 

We quickly summarize some information theoretic concepts and notation we use in this article. For a more 
comprehensive treatment, we refer the reader to a text such as [19]. 

All logarithms in this article are taken to the base 2. For < p < 1, H(p) = —p\ogp — [1 — p) log(l — p) 
denotes the binary entropy function. The following fact (see, e.g., [6, page 1224, Fig. 1]) bounds the binary 
entropy function close to 1/2: 

Fact 3.1 For 5 G [-i, H(i + 5) < ^\ - (25)2. 

Let Ji^lfi be Hilbert spaces. For a quantum state p G L('H), we call a pure state |(/)) GTiiSilC a purification 

of p if Tt]c |</>) {(pl = p- The fidelity between (mixed) quantum states p, a is defined as B{p, a) = sup | \ , 
where the optimization is over states which are purifications of p and respectively. The trace 

norm of an operator A G L('H) is defined as \\A\\t = Tr V A^A. 

The fidelity of two mixed states may be expressed in terms of the trace norm. 

Theorem 3.2 (Uhlmann [13,25]) For any quantum states p and a, B(p, cj) = ||y^-v/o'||t- 

The von-Neumann entropy of a quantum state p is defined as S{p) = — Tr plogp. The Kullback-Leibler 

divergence or relative entropy between two quantum states p,a is defined as S(p||(t) = Tr p{\ogp— logu). 
The following fact relates fidelity and relative entropy: 

Lemma 3.3 (Dacunha-Castelle [2]) For any quantum states p,a, we have S{p\\a) > —2 log B(p, cr). 
The following relation follows from the definitions: 

Lemma 3.4 Let X be a random variable over a finite sample space and let px = Pr(X = x). Let M be a 
quantum encoding of X such that M = p^ when X = x. Let p = Ea;[p2,] = 'YlixPxPx- Then 1{X : M) = 
Ex[S(p.||p)]. 

3.2 The lower bounds 

We begin with a property of fidelity that we later use. 
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Lemma 3.5 Let £ = {{p-,po), {l—p,pi)} be an ensemble of commuting quantum states of arbitrary (finite) 
dimension, and let p = p pQ + (1 — p) pi. Then 

pB{po,p) + {l-p)B{pi,p) < [p^ + {l-pf + 2p{l-p)B{po,p^)Y^\ 

Proof: For any two commuting positive semi-definite matrices A, B, we have 

P^llt = TvAB. 

Since po,pi,p all commute, we have 



pB(po,p) + (l-p)B(pi,p) 

= Pll\/A)\/^llt + (1 -p) ll^/pT^/pllt 
= pTr[V^^ + (l-p)TV[^^ 
= TV[(p^+(l-p)^)-^ 



< 



Tr {p^/po + {'^-p)Vpi) 



1/2 



[Tip] 



1/2 



By Theorem 



By Cauchy- Schwartz 



[p2 + (1 - pf + 2p{l - p) Tr {^^] 



,1/2 



which is the inequality we seek. ■ 

We now bound the accessible information from below by the mutual information achieved by a measurement 
that preserves fidelity. 

Lemma 3.6 Let £ = {{p,po), (l~PiPi)} be an ensemble of quantum states of arbitrary (finite) dimension. 
Then 



l.cc{£) > H(p) -2Vp(1-p) B{po,p,), and 
l.cc{£) > -log2 [/ + (l-p)2 + 2p(l-p)B(po,Pi: 



(5) 
(6) 



f: Let Pq, Pi be the classical distributions resulting from a measurement that achieves the fidelity 
en pq and pi (see Ref. [5]), so that B{pq, p[) = B{pQ,pi). Let p' = pp^ + (1 — p)pi. Let M' be the 



Proof: 

between _ 

encoding of X such that M' = pg when X = and M' = p'^ when X = 1. Let 



go(m) = Pv{M' = m\X = 0) 

= Pr(M' = m), and 
A 



q{m) 
ro(m) 



Fv{X = 0\M' = m). 



We similarly define qi{m). Note that 

q{m) rQ{m) = p qQ{m) and q{m) {1 — rQ{m)) = {I — p) qi{m). 



(7) 
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We now have 



Iacc(^^) > 1{X : M') 

= H(p) — q{m) H(ro(m)) 



> H(p) - ^ g(m) • 2v^ro(m) (1 - ro(m)) 

m 

= H(p) - ^ 2a/p(1 - p) qoim) qi{m) 



From Fact 13.11 
From Eq. (HD 



Rip)-2y'p{l-p)Bip'o,p[). 



This proves the bound in Eq. ([5]). 
For the second part, Eq. ([6]), we have 



From Lemma 13.41 
From Lemma 13.31 
By convexity 
By Lemma 13.51 



lacc(f) > I(X : M') 

= PS(/9o||p') + (1 -p)S(p'l||/9') 

> -2plogB{p'o,p')-2{l-p) logB{p[,p') 

> -2 log {pB{p'o,p') + {l-p) Bip[,p')) 

> - log (p2 + (1 - pf + 2p(l - p) B{p'o,p[)) 

Since B(pq,/9']^) = B{pQ,pi), the bound follows. ■ 

The bounds in the above lemma are incomparable, in that they surpass each other in different parameter 
regimes as described in Section [TJ 

Next we observe that for pure quantum states, there is a direct relationship between fidelity and the 
Holevo-x quantity. 

Lemma 3.7 Let £ = {{p,po), (1 ~PiPi)} be an ensemble such that po,pi are pure states. Then, 



X{S) < 2y/p{l-p){l-Bipo,piy). 

Proof: Let 6 £ [0,tt/2] be the angle between the pure states po and pi so that B{pQ,pi] 
P = PPo + (1 ~ p)pi- By a direct calculation we see that the eigenvalues of p are 



cos 9. Let 



1 ± - - p) 



sm 



Therefore from Fact 13.11 we have, 



X{S) = Sip) 



H 



1 + a/I - 4p(l — p) sin^ I 



< (2sin0)Vp(l-p) = 2Vp(1-p)(1-B(po,/Oi)2). 



As a corollary of the above lemma, we get: 
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Corollary 3.8 Let £ = {{p,po), (1 ~P-,Pi)} be an ensemble where po,Pi may he mixed states. Then, 

X{S) < 2y/p{l-p){l-B{po,p,)^). 

Proof: As before, let \(j)o), \4>i) be purifications of po, pi which achieve fidelity between the two states. Let 
us consider the encoding M' of X such that M' = |0o) when X = and M' = {(pi) when X = 1. From 
the strong sub-additivity property of von Neumann entropy it follows that 1(X : M) < 1{X : M'). Using 
Lemma 13.71 we have 



1{X : M) < 1{X : M' 



< 2^pil-p){l-Bi\cPo){M,\<l>i){<Pi\r) 
= 2Vp(1-p)(1-B(po,Pi)2), 

as required. 

Finally we get our main result, Theorem I l.li 

Proof of Theorem II. It From Corollary 13.81 we have 



6(^0,^1) < 



1 



1/2 



4p(l - p) 

The inequalities follow by combining the above with those in Lemma [37 



4 Concluding remarks 



In Theorem II. II we bounded the accessible information of an arbitrary ensemble corresponding to a binary 
random variable from below, by relating it to the Holevo x quantity. By a theorem of Ruskai [22, Sec- 
tion VII. B], whenever the states in the ensemble are not orthogonal (or equal), no measurement achieves 
Holevo information. This also rules out the possibility of the two quantities being equal in the limit of 
more and more refined measurements, since the number of outcomes in the optimal measurement on a 
finite dimensional space may be bounded by the Davies Theorem [3, Theorem 3]. This implies that the 
Holevo bound is strict for ensembles of non-orthogonal states. The significance of our lower bounds is that 
they quantify the extent to which accessible information may be smaller than Holevo information. 

In Section [2l we pointed out some advantages of our bounds vis-a-vis previously known lower bounds. 
Along with the intermediate bounds we obtain in Lemma 13.61 and Corollary 13.81 Theorem 11.11 also adds 
to the suite of relations between different distinguishability measures such as those identified by Fuchs 
and van de Graaf [6]. These relations have found applications in a variety of areas — information theory, 
cryptography, and communication complexity. We anticipate that our bounds find similar application. 
Finally, we believe that our bounds may be further tightened. Due to the basic nature of the question, the 
existence of a tighter bound would be of interest regardless of potential applications. 
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